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14.  ABSTRACT 

Our  research  focused  on  developing  and  evaluating  general,  effective,  and  efficient  algorithms  for  learning 
of  long-term  knowledge  in  autonomous  agents,  as  well  as  developing  cognitive  capabilities  that  exploit  that 
learning.  Our  work  has  covered  episodic  memory,  semantic  memory,  and  procedural  memory,  integrated 
within  a  general  cognitive  architecture  (Soar).  For  episodic  memory,  our  research  has  led  to  significant 
improvements  in  the  efficiency  of  storage  (memory)  and  retrieval  (time)  through  the  exploitation  of 
temporal  contiguity,  structural  regularity,  high  cue  structural  selectivity,  high  temporal  selectivity,  low  cue 
feature  co-occurrence,  resulting  in  no  significant  slowdown  with  experience:  runs  for  days  of  real  time 
(tens  of  millions  of  episodes),  faster  than  real  time  [Laird,  Derbinsky,  &  Voigt  2011;  Derbinsky,  Li  &  Laird 
2012a].  We  evaluated  our  approach  on  multiple  tasks  (including  mobile  robotics,  games,  planning 
problems,  linguistics)  and  for  multiple  cognitive  capabilities  [Laird,  Derbinsky,  &  Voigt  2011;  Laird  & 
Derbinsky  2011c;  Derbinsky,  Li  &  Laird  2012b].  For  semantic  memory  retrieval,  we  studied  and  evaluated 
multiple  functions  for  biasing  retrieval,  and  developed  efficient  approximate  algorithm  that  maintains  high 
(>90%)  validity  for  base-level  activation  (the  best  performing  in  terms  of  quality).  Our  algorithm  is  30-100 
times  faster  than  prior  retrieval  algorithms  and  has  sub  linear  slowdown  as  memory  size  increases 
[Derbinsky,  Laird,  &  Smith  2010;  Laird  &  Derbinsky  2011a;  Derbinsky  &  Laird  2011b].  We  also 
developed  algorithms  to  use  semantic  memory  to  support  reconstruction  of  forgotten  working  memory 
[Derbinsky  &  Laird  2011c;  Derbinsky  &  Laird  2012a].  This  research  was  evaluated  on  multiple  domains 
including  word  sense  disambiguation  and  mobile  robotics.  [Derbinsky,  Laird,  &  Smith  2010;  Laird, 
Derbinsky,  &  Voigt  2011;  Derbinsky  &  Laird  2011b].  We  also  developed  algorithms  for 
retaining/forgetting  of  knowledge  in  working  memory  and  procedural  memory  to  improve  the  scalability 
of  episodic  memory  and  procedural  memory  [Laird  &  Derbinsky  2011c;  Derbinsky  &  Laird  2012b; 
Derbinsky  &  Laird  2013].  Our  final  research  was  on  learning  value  functions  for  reinforcement  learning 
[Laird,  Derbinsky,  Tinkerhess  2012;  Bloch  &  Laird  2013]. 
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Abstract:  Our  research  focused  on  developing  and  evaluating  general,  effective,  and  efficient 
algorithms  for  learning  of  long-term  knowledge  in  autonomous  agents,  as  well  as  developing 
cognitive  capabilities  that  exploit  that  learning.  Our  work  has  covered  episodic  memory,  semantic 
memory,  and  procedural  memory,  integrated  within  a  general  cognitive  architecture  (Soar).  For 
episodic  memory,  our  research  has  led  to  significant  improvements  in  the  efficiency  of  storage 
(memory)  and  retrieval  (time)  through  the  exploitation  of  temporal  contiguity,  structural  regularity, 
high  cue  structural  selectivity,  high  temporal  selectivity,  low  cue  feature  co-occurrence,  resulting  in  no 
significant  slowdown  with  experience:  runs  for  days  of  real  time  (tens  of  millions  of  episodes),  faster 
than  real  time  [Laird,  Derbinsky,  &  Voigt  2011;  Derbinsky,  Li  &  Laird  2012a],  We  evaluated  our 
approach  on  multiple  tasks  (including  mobile  robotics,  games,  planning  problems,  linguistics)  and  for 
multiple  cognitive  capabilities  [Laird,  Derbinsky,  &  Voigt  2011;  Laird  &  Derbinsky  2011c;  Derbinsky,  Li 
&  Laird  2012b], 

For  semantic  memory  retrieval,  we  studied  and  evaluated  multiple  functions  for  biasing  retrieval,  and 
developed  efficient  approximate  algorithm  that  maintains  high  (>90%)  validity  for  base-level 
activation  (the  best  performing  in  terms  of  quality).  Our  algorithm  is  30-100  times  faster  than  prior 
retrieval  algorithms  and  has  sub  linear  slowdown  as  memory  size  increases  [Derbinsky,  Laird,  &  Smith 
2010;  Laird  &  Derbinsky  2011a;  Derbinsky  &  Laird  201113],  We  also  developed  algorithms  to  use 
semantic  memory  to  support  reconstruction  of  forgotten  working  memory  [Derbinsky  &  Laird  2011c; 
Derbinsky  &  Laird  2012a],  This  research  was  evaluated  on  multiple  domains  including  word  sense 
disambiguation  and  mobile  robotics.  [Derbinsky,  Laird,  &  Smith  2010;  Laird,  Derbinsky,  &  Voigt  2011; 
Derbinsky  &  Laird  2011b], 

We  also  developed  algorithms  for  retaining/forgetting  of  knowledge  in  working  memory  and 
procedural  memory  to  improve  the  scalability  of  episodic  memory  and  procedural  memory  [Laird  & 
Derbinsky  2011c;  Derbinsky  &  Laird  2012b;  Derbinsky  &  Laird  2013], 

Our  final  research  was  on  learning  value  functions  for  reinforcement  learning  [Laird,  Derbinsky, 
Tinkerhess  2012;  Bloch  &  Laird  2013], 
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